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ABSTRACT 

Objectives: High-quality reporting of treatment details 
can aid replication of study results in real-world clinical 
practice. The Standards for Reporting Interventions in 
Clinical Trials of Acupuncture (STRICTA) is a reporting 
guideline for key elements of acupuncture interventions 
in clinical trials. This study used STRICTA to 
investigate whether Cochrane reviews of acupuncture 
adequately report important treatment details. 
Design: Systematic review 
Methods: Cochrane reviews of acupuncture were 
identified from The Cochrane Library (issue 7, 2012). 
Randomised controlled trials (RCTs) included in the 
reviews and published after 2005 were obtained. Using 
STRICTA, we extracted acupuncture-related information 
from the Cochrane reviews and the RCTs. The 
characteristics of the included studies' table were the 
major source of intervention information from 
Cochrane reviews. Reporting quality of acupuncture 
interventions in Cochrane reviews was assessed and 
compared with the respective RCTs. 
Results: 25 Cochrane reviews of acupuncture and 92 
RCTs met the selection criteria. Cochrane reviews were 
16% less likely to report the acupuncture-related items 
of STRICTA than RCTs (risk ratio 0.84, 95% CI 0.79 to 
0.88, l 2 =8%). Information was significantly better 
reported for 10 of the 15 treatment-group items of 
STRICTA in RCTs than in Cochrane reviews (p<0.05), 
while four items did so without statistical significance. 
One item related to practitioner background was 
significantly better reported in Cochrane reviews. 
Conclusions: Reporting quality of treatment details in 
Cochrane reviews of acupuncture was insufficient with 
regard to STRICTA, even though such information was 
readily reported in RCTs. The overall quality of reporting 
of the RCTs, while better than the reviews, was also often 
suboptimal. Use of STRICTA guideline during the review 
process is recommended to adequately report the key 
treatment components in Cochrane reviews of 
acupuncture. The potential impact of STRICTA to the 
replicability and utilisation of reviews in future research 
and practice needs to be investigated. 



BACKGROUND 

Cochrane systematic reviews have summaries 
of study characteristics, which aim to include 



Strengths and limitations of this study 



■ This study is the first investigation that revealed 
the avoidable incompleteness of reporting quality 
with regard to important treatment components 
of acupuncture in the Cochrane reviews, even 
though information was readily reported in rele- 
vant primary randomised controlled trials. 

■ Our findings suggest that there is a loss of 
treatment-related information during data 
abstraction for Cochrane reviews which may 
influence the replicability of trial interventions. 

■ Whether loss of treatment-related information 
actually leads to the altered replicability of 
reported interventions in Cochrane reviews was 



not investigated. 




details of study interventions to be replicated 
in practice. 1 Developing methods to improve 
the descriptions of complex interventions is 
considered as an essential task to complement 
existing systematic review methodology. 2 
Therefore, adherence to international stan- 
dards for reporting interventions might be 
helpful for detailed description of study inter- 
ventions in Characteristics summaries in 
Cochrane systematic reviews. The Standards 
for Reporting Interventions in Clinical Trials 
of Acupuncture (STRICTA) is an internation- 
ally recommended standard for reporting 
details of acupuncture interventions in clinical 
trials of acupuncture. It can be used to provide 
sufficient information for researchers or clini- 
cians to understand acupuncture interventions 
used in the study and replicate them in other 
researches or practices. 3 Consolidated 
Standards of Reporting Trials (CONSORT) for 
non-pharmacological treatments has also sug- 
gested to provide detailed information for 
study interventions, thus to improve the 
uptake of study results in studies of complex 
interventions, including surgery, psychological 
interventions and acupuncture. 4 However, 
many current trials and reviews have been 
found to often omit crucial details of non- 
pharmacological treatments. 5 In case of 
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Cochrane reviews, clear description on the intervention of 
interests has been emphasised to improve applicability of 
review into real clinical practice. 6 To the best of our knowl- 
edge, however, there is no study assessing whether 
Cochrane reviews provide satisfactory description on any 
particular intervention by adopting standards for report- 
ing interventions. Although previous researches focused 
on managing the reporting quality of Cochrane review in 
terms of methodological process, 7 the reporting quality 
for interventions in Cochrane review had been largely 
ignored. Hence, this study aimed to assess the reporting 
quality of acupuncture treatment-related information in 
the Cochrane reviews of acupuncture, as well as to investi- 
gate whether utilisation of the reporting guideline for 
treatment intervention can improve the quality of report- 
ing in Cochrane reviews of acupuncture. 

METHODS 

Search strategy and selection criteria for Cochrane 
reviews of acupuncture 

Cochrane Database of Systematic Reviews (CDSR) of 
issue 7 March 2012 was searched to identify Cochrane 
reviews of acupuncture using the term 'acupuncture'. 
Cochrane reviews that investigated acupuncture as a 
primary treatment intervention or as one of various 
treatment or control interventions with at least one 
primary component study that assessed the effects of 
acupuncture were included. Reviews without any 
included study (ie, empty reviews) or reviews that did 
not include acupuncture-related studies were excluded. 

Search strategy and selection criteria for component 
studies in eligible Cochrane reviews of acupuncture 

Component study was defined as a study included in the 
Cochrane review regardless of the contribution to the 
qualitative or quantitative analyses. These were searched 
using the reference citation information provided in the 
relevant Cochrane reviews. Among studies in eligible 
Cochrane systematic reviews, only trials published since 
2005 were considered to be analysed in this study. This is 
because of the possible necessary time-span for uptake 
of STRICTA guideline. This approach is similar to the 
work of Prady et a/ 8 which analysed acupuncture studies 
published after 3-4 years following the publication of 
STRICTA. Component studies which involved the assess- 
ment of acupuncture as a treatment or control interven- 
tion were eligible in our study. The term 'acupuncture' 
was defined as interventions involving penetration of 
certain points on the skin by needling regardless of 
manual or electrical stimulation, since needling is 
believed to be the most representative feature of acu- 
puncture and STRICTA items were originally developed 
for the reporting of needle acupuncture in clinical 
studies. 3 Thus, component studies using other types of 
non-penetrating stimulation on acupuncture points, 
such as laser acupuncture, acupressure, device-involved 
acupuncture point stimulation (ie, wrist band 



application) and injections on acupuncture points were 
excluded. Studies employing stimulation on non-classical 
acupuncture points, such as trigger points, were eligible 
only if they clearly mentioned in the review that the 
intervention was 'acupuncture'. 

Data extraction in Cochrane reviews of acupuncture 

Intervention details for acupuncture treatments in tables 
for characteristics of included component studies were 
extracted in each Cochrane review. Characteristics of 
included component studies were chosen for the main 
data source of our analysis because they intend to 
provide sufficient information on various study compo- 
nents including details of interventions to enable 
readers to understand the study better or replicate inter- 
ventions in their own contexts. 1 Methods and results of 
the included Cochrane reviews were also examined to 
identify further acupuncture-related information which 
was not reported in the tables. Two independent 
authors underwent these processes. 

General characteristics of each component study, 
including publication languages (English or 
non-English), type of control groups in primary compo- 
nent studies, publication or last-updated years and the 
number of included studies in the Cochrane reviews 
were extracted. Whether clinical heterogeneity related 
to the acupuncture treatments were planned to be inves- 
tigated by subgroup, sensitivity or other analysis regard- 
less of the availability of those analyses was also 
identified. One review author conducted these 
processes. 

Data extraction in component studies 

For included studies to be analysed, full-texts were 
obtained to check whether there is any difference of 
reported information for acupuncture treatments in 
terms of STRICTA items between the primary compo- 
nent studies and the Cochrane review. This was carried 
out to identify any selective omission of 
treatment-related information by the Cochrane review 
author. Published protocols or supplements of included 
studies for more detailed information were further 
sought when the primary component studies had rele- 
vant information for tracking such data (ie, citation 
information in the reference or web-appendix provided 
by the component study) . 

Selection of STRICTA items for data extraction 

Acupuncture-related items of STRICTA were used to 
assess the quality of reporting for acupuncture 
treatment-related information in Cochrane reviews of 
acupuncture. Items with regard to the description of the 
comparison interventions were not used, because the 
main interest of this review was to assess the complete- 
ness of description of the acupuncture treatment itself. 
The revised STRICTA checklist published in 2010 served 
as a primary source of extraction form of acupuncture- 
related information. 3 
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Rating methods of items in STRICTA 

Each item of STRICTA was rated with a dichotomous 
scale (ie, 'reported' or 'not reported'). The rating of 
'reported' was given when relevant information is at 
least partially reported in the Cochrane review or 
primary component studies. The rating of 'not reported' 
was given when relevant information is completely 
lacked in the Cochrane reviews or primary component 
studies. When there is written evidence in the Cochrane 
review that the review authors attempted to report and 
sought the relevant information but could not find it in 
the component study, the item was rated as successfully 
reported one in the Cochrane review. Our approach is 
in line with the Preferred Reporting Items for Systematic 
Reviews and Meta-Analyses (PRISMA) statements that 
stressed the importance of reporting all variables for 
which data were sought, regardless of its availability in 
the component studies. 7 STRICTA recommends report- 
ing of actually performed acupuncture intervention, 
rather than reporting of treatment protocols without any 
evidence of implementation. However, we assumed the 
reporting of Cochrane reviews or of component studies 
as performed, because distinctions were not clear in 
most cases. 

Inquiries to the review authors and review groups 

One author (KHK) visited websites of relevant Cochrane 
review groups (CRGs) to see whether any reporting guide- 
lines for acupuncture-related intervention were provided 
for review authors (accessed on 12 July 2012). Email 
queries were sent to the contact point of CRGs. Two ques- 
tions were used for the survey as follows: 'Do your CRG 
have a policy or specific recommendations about the 
reporting details of acupuncture interventions for review 
authors? If any, please specify' and 'Have you ever recom- 
mended any specific guideline for reporting details of acu- 
puncture interventions for the review to review authors? If 
any, please specify', respectively. Similar email queries with 
four questions were sent to the correspondence of the 
included Cochrane reviews (table 1). This was carried out 



Table 1 Response of review authors for the reporting of 
acupuncture details in the Cochrane review 



N=25 


Q1 (%) 


Q2 (%) 


Q3 (%) 


Q4 (%) 


Yes 


1 1 (44) 


4(16) 


0(0) 


0(0) 


No 


2(8) 


5(20) 


10 (40) 


8 (32) 


No answer 


12 (48) 


16(64) 


15 (60) 


17 (68) 



Q1 . Are you aware of any guideline or recommendation for 
reporting details of acupuncture treatment in journal publication? 
Q2. Have you ever referred or used any reporting guidelines or 
recommendations when you reported the details of acupuncture 
treatments in your Cochrane review? 

Q3. Have you ever received any guideline or recommendation for 

reporting details of acupuncture treatment from the Cochrane 

review group, when writing or updating your review? 

Q4. Have you ever received any constraints or restrictions when 

reporting the details of acupuncture treatments in your Cochrane 

review? 



to check whether CRGs or review authors had been aware 
of the existence of reporting guidelines on acupuncture 
(ie, STRICTA), had or had been recommended to use 
reporting guidelines for detailed description of interven- 
tions regarding acupuncture. 

Training of trial assessors 

Two reviewers (KHK and JWK), experienced acupunc- 
ture researchers and systematic reviewers, received train- 
ing on STRICTA assessment checklists. The training 
course aimed to minimise inconsistency in data extrac- 
tion and scoring. Ten trials in the Cochrane reviews that 
were published before 2005, thus excluded in our ana- 
lyses, were randomly selected for initial scoring by both 
reviewers. Two reviewers independently assessed and 
scored the quality of reporting in terms of acupuncture 
treatment-related information of 10 component trials in 
the Cochrane reviews. Following this, we attempted to 
develop and reassure the standardised scoring instruc- 
tion for the main analysis. 

Statistical analysis 

The number of items rated as 'reported' in the 
Cochrane review was compared with those in the rele- 
vant primary component studies. Results were presented 
as risk ratios (RRs) with 95% CIs. Random effects model 
was used, and heterogeneity was analysed using % 2 test 
on N-l degrees of freedom, with an a of 0.05 used for 
statistical significance and with the I 2 statistic. The 
number and proportion of component studies in the 
Cochrane reviews and the original randomised con- 
trolled trials (RCTs) that reported information for each 
STRICTA item were compared using the McNemar test 
as percentage reported with binomial 95% CIs. STATA 
V.10.0 (Stata-Corp, College Station, Texas, USA) and 
RevMan V.5.2 (The Nordic Cochrane Centre, 
Copenhagen, Denmark) were used for statistical analyses 
and the forest plot, respectively. 

RESULTS 

A total of 74 Cochrane reviews were identified following 
the search of CDSR, of which 26 reviews with 96 compo- 
nent studies were deemed to be eligible. Among them, 
one review and four component studies were excluded 
from the analysis, because of the wrong citation (n=3) 
and no accessibility (n=l) of component studies that 
resulted in the analysis of 25 reviews and 92 component 
studies (figure 1). 

Study characteristics 

Of the 25 included Cochrane reviews of acupuncture, 17 
reviews (68%) evaluated acupuncture as a primary inter- 
vention of interest. The median value of publication 
year or year that last update was performed was 2010. In 
total, 12 reviews (48%) attempted to investigate the clin- 
ical heterogeneity related to acupuncture treatment by 
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GO 

c 
'E 

a> 



Records identified through CDSR 
searching 

- Cochrane review (n = 74) 

- Component trials (n=834) 



'5b 



Records screened 

- Cochrane review (n =59) 

- Component trials (n=420) 



Records excluded 

- Empty review (n =5) 

- Not an intervention 
review (n=2) 

- Not including trials of 
acupuncture (n=7) 

- Withdrawal (n=l) 



Reviews trials excluded in 
primary analysis 

- Reviews with no acupuncture 
trials after 2005 (n=28) 

- Reviews with no needling 
acupuncture trials (n=5) 

Reviews that have a 
component study not 
accessible (n=l) 

- Component trials published 
before 2005 (n=3 07) 

- Component trials with no 
needling acupuncture (n=17) 

Component trials not 
accessible (n=l) 

- Component trials with wrong 
citation (n=3) 



3 



Reviews, trials contributed 
the final primary analysis 

- Cochrane reviews (n =25) 

- Component trials (n = 92) 



to 



Figure 1 Flowchart of Cochrane reviews and component study selections. CDSR; Cochrane Database of Systematic Reviews. 



the means of subgroup, sensitivity or other type of ana- 
lysis (ie, acupuncture adequacy test) . 

Of the 92 component studies, 58 studies (63%) were 
published in English. The median value of publication 
year of component studies published after 2005 was 
2007. Type of comparison to acupuncture was non- 
acupuncture interventions (n=68, 74%), sham acupunc- 
ture (n=34, 37%) and active acupuncture treatments 
(n=14, 15%). Details of characteristics for Cochrane acu- 
puncture reviews and component studies are provided 
in table 2. 

Review policy or recommendations for the reporting 
acupuncture intervention 

No CRG policy or recommendations given to the review 
author for reporting of acupuncture treatment were 
identified by an email survey to the CRG correspond- 
ence or review authors. Five of 16 CRGs replied that the 
Cochrane Handbook should serve as a general standard 
guideline for reporting in the review, although no 
detailed instructions or any recommendations for 
reporting the details or at least core components of 



complex interventions such as acupuncture were pro- 
vided to authors. One CRG of the Cochrane review that 
did not evaluate acupuncture as primary intervention 
reported that they sought the feedback from an acu- 
puncture specialist during editorial process. Less than 
half of the reviewers (44%) reported that they were 
aware of STRICTA and only 16% of reviewers had uti- 
lised STRICTA during the review process. The reviewers 
did not receive either recommendation or restriction in 
terms of reporting acupuncture treatment during their 
review process (table 1). 

STRICTA reporting in the Cochrane reviews and in the 
component studies 

RR of the reporting rate of STRICTA items was 0.84 (95% 
CI 0.79 to 0.88, I 2 =8%), indicating that Cochrane reviews 
were 16% less likely to report the acupuncture-related 
items of STRICTA than component RCTs (figure 2). 
Information was significantly better reported for 10 of the 
15 acupuncture treatment-related items of STRICTA in 
RCTs than in Cochrane reviews ( p<0.05) , while four items 
did so without statistical significance (table 3). The most 
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Table 2 General characteristics of Cochrane reviews 


related to acupuncture 






Included Cochrane 




reviews N=25 


Mi imhor /™\f PA/^hrono mi i\ /~\\mo M / O/ \ 
IMUlllUcr Ul V^UUIird.llc IgVIgWo, N ^/oj 




Acupuncture as primary 


17 


Acupuncture as secondary 


8 


Number of component study 




Total 


409 


Mean 


16.36 (11.77) 


Median (Q1-Q3) 


13 (3-47) 


Number of component study published after 2005 


Total 


92 


Mean 


3.7 (3.85) 


Median (Q1-Q3) 


2 (1-5) 


Publication language of component 




studies after 2005, N (%) 




Total 


92 


English 


58 (63) 


Languages other than English 


34 (37) 


Number of component studies published in 


Acupuncture-related journal 


47 


Western medicine journal 


43 


Publication year 




Cochrane review (Q1-Q3) 


2010 (2008-2011) 


Component studies (Q1-Q3) 


2007 (2006-2008) 


Types of control*, N (%) 




Sham acupuncture 


34 (37) 


Active acupuncture 


14 (15) 


Non-acupuncture 


68 (74) 


Clinical heterogeneity related to acupuncture 


Investigated 


12 (48%) 


in subgroup analysis 


5 (20%) 


in sensitivity analysis 


6 (24%) 


in other analysis 


8 (32%) 


Not investigated 


13 (52%) 


*Sum of the number of each control group may exceed the total 


number of included trials, since there are trials that have more 


than two control groups. 




Q1-Q3: IQR 1-3. 





significant difference of reporting rate was found for the 
item A2 (reasoning of treatment) and B7 (needle type) 
with better reporting in 39.1% and 45.7% of RCTs, 
respectively. One item (El) related to practitioner back- 
ground was significantly better reported in Cochrane 
reviews. Four items including A2 (reasoning of treatment) , 
B3 (depth of insertion), Dl (details of other treatments) 
and D2 (setting and context) were reported in less than 
half of component studies in the Cochrane reviews and of 
RCTs. 



DISCUSSION 

This study is the first systematic investigation of selective 
reporting in terms of details of interventions in the 
Cochrane reviews of acupuncture. We found some items 
which have been regarded as core components of acu- 
puncture treatments were not reported in the Cochrane 
review, even though that information was already 



reported in the component RCTs. Details of interven- 
tions were significantly better reported in the RCTs in 
most items of STRICTA. This was achieved without 
further contact of authors of RCTs, which might imply 
the improvement of the reporting quality in terms of 
intervention details could be achieved directly by adopt- 
ing STRICTA as a guideline for data abstraction by 
reviewers, editorials and peer-reviewers. However, no spe- 
cific recommendation or guidelines for review authors 
were provided by CRG, and only a minor portion of 
review authors or members of CRGs were identified to 
be aware of the existing CONSORT extension version of 
acupuncture. Overall, there is an insufficient reporting 
of acupuncture details which could have been improved 
if the existing reporting guidelines were well utilised in 
the review process. 

In our review, less reporting of treatment-related infor- 
mation in the Cochrane reviews was observed in most of 
the selected STRICTA items. To some extent, missing 
details of complex intervention might be inevitable 
during abstraction of information due to the complexity 
in practice. 5 However, some items showed almost com- 
patible or even better reporting quality in the Cochrane 
reviews than in the RCTs. For example, information 
regarding the practitioner qualification was relatively 
well reported (over 60% of component studies). Some 
of the mechanical aspects of acupuncture treatments 
were also relatively well reported in Cochrane reviews 
and primary component studies, although some showed 
modest reporting quality in Cochrane reviews and RCTs. 
Item B7 (needle type) showed the most difference 
(45.7% difference) of reporting rates between Cochrane 
reviews and primary component studies. This is in line 
with the previous research that common missing 
element of non-pharmacological interventions in RCTs 
were materials necessary to provide the intervention 
(47% complete) published in six major general jour- 
nals. 9 On the contrary, poor reporting of contextual 
factors (Dl, details of other treatments; and D2, setting 
and context) was obvious in Cochrane reviews and 
primary component studies. Although treatment context 
can have a significant influence on treatment effects, 10 
reporting information related to study contexts and 
patient-practitioner interactions seems to have been 
largely ignored by researchers of complex interven- 
tion. 11 Since acupuncture is a practitioner-dependent, 
non-pharmacological complex intervention, 12 sufficient 
details of intervention delivered and study contexts 
might be of particular importance to enable readers to 
consider the application and reproduction of review 
results in different treatment settings. 11 Items that 
explain theoretical background of acupuncture interven- 
tion were also largely under-reported in Cochrane 
reviews of acupuncture, although theoretically-derived 
therapeutic actions or strategies in complex interven- 
tions such as acupuncture may also have an important 
role in constituting overall therapeutic effects. 12 It is still 
unclear for acupuncture which component exerts 
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Figure 2 The number of 
reported items of STRICTA in 
Cochrane reviews of acupuncture 
and related RCTs. RCT, 
randomised controlled trial. 



Study or Subgroup 


Events 


Total 


Events 


Total 


Weight 


M-H, Random. 95% CI 


Foster2007 


10 


15 


15 


15 


2.0% 


0.68 [0.47, 0.98] 


Scharf2006 


11 


15 


15 


15 


2.5% 


0.74 [0.54, 1.02] 


Williamson2007 


10 


15 


13 


15 


1 .7% 


0.77 [0.51, 1.16] 


Witt2005 


10 


15 


13 


15 


1 .7% 


0.77 [0.51, 1.16] 


Witt2006 


11 


15 


12 


15 


1 .8% 


0.92 [0.62, 1 .36] 


Alecrim2005 


7 


15 


7 


15 


0.5% 


1.00 [0.47, 2.15] 


Alecrim2006 


8 


15 


13 


15 


1.1% 


0.62 [0.37, 1.03] 


Alecrim2008 


7 


15 


11 


15 


0.8% 


0.64 [0.34, 1.18] 


Diener2006 


7 


15 


15 


15 


1.1% 


0.48 [0.29, 0.82] 


Facco2008 


7 


15 


10 


15 


0.7% 


0.70 [0.37, 1 .34] 


Jena2008 


6 


15 


7 


15 


0.5% 


0.86 [0.38, 1.95] 


Linde K 2005 


8 


15 


11 


15 


0.9% 


0.73 [0.41, 1.28] 


Linde M 2005 


8 


15 


12 


15 


1 .0% 


0.67 [0.39, 1.14] 


Streng2006 


6 


15 


11 


15 


0.6% 


0.55 [0.27, 1.09] 


Allen2006 


9 


15 


15 


15 


1 .6% 


0.61 [0.40, 0.93] 


Cheng2007 


11 


15 


12 


15 


1 .8% 


0.92 [0.62, 1 .36] 


Dong2007 


10 


15 


1 1 


15 


1 .3% 


0.91 [0.57, 1.45] 


Duan2008 


7 


15 


8 


15 


0.6% 


0.88 [0.43, 1.80] 


Fan2005 


7 


15 


11 


15 


0.8% 


0.64 [0.34, 1.18] 


Fu2008 


10 


15 


12 


15 


1 .5% 


0.83 [0.54, 1.29] 


He2005 


10 


15 


10 


15 


1.1% 


1 .00 [0.60, 1 .66] 


He2007 


8 


15 


11 


15 


0.9% 


0.73 [0.41, 1.28] 


Li2007 


7 


15 


9 


15 


0.7% 


0.78 [0.39, 1.54] 


Shen2005 


8 


15 


9 


15 


0.8% 


0.89 [0.47, 1.67] 


Wang2006 


9 


15 


9 


15 


0.9% 


1.00 [0.56, 1.79] 


Whiting2008 


8 


15 


10 


15 


0.9% 


0.80 [0.44, 1 .45] 


Zhang2007 


7 


15 


7 


15 


0.5% 


1.00 [0.47, 2.15] 


Allam2008 


12 


15 


12 


15 


2.1% 


1 .00 [0.70, 1 .43] 


Wang2007 


11 


15 


12 


15 


1 .8% 


0.92 [0.62, 1 .36] 


Wong2008 


12 


15 


14 


15 


3.0% 


0.86 [0.64, 1.14] 


Wong2010a 


11 


15 


11 


15 


1 .5% 


1.00 [0.65, 1.54] 


Wong2010b 


9 


15 


9 


15 


0.9% 


1 .00 [0.56, 1 .79] 


Yan2007 


8 


15 


8 


15 


0.7% 


1.00 [0.51, 1.95] 


Benson2006 


3 


15 


3 


15 


0.2% 


1.00 [0.24, 4.18] 


Craig2007 


5 


15 


6 


15 


0.3% 


0.83 [0.32, 2.15] 


Dieterle2006 


7 


15 


11 


15 


0.8% 


0.64 [0.34, 1.18] 


Gejervall2005 


5 


15 


12 


15 


0.5% 


0.42 [0.20, 0.89] 


Sator-K2006 


6 


15 


10 


15 


0.6% 


0.60 [0.29, 1.23] 


Smith2006 


6 


15 


11 


15 


0.6% 


0.55 [0.27, 1.09] 


Westergaard2006 


5 


15 


10 


15 


0.5% 


0.50 [0.22, 1.11] 


An2010 


12 


15 


9 


15 


1 .2% 


1.33 [0.82, 2.16] 


Anastasi2009 


12 


15 


14 


15 


3.0% 


0.86 [0.64, 1.14] 


Chen2009 


12 


15 


11 


15 


1 .8% 


1.09 [0.73, 1.62] 


Chen2011 


12 


15 


10 


15 


1 .5% 


1.20 [0.77, 1.86] 


Forbes2005 


11 


15 


11 


15 


1 .5% 


1.00 [0.65, 1.54] 


Lembo2009 


11 


15 


12 


15 


1 .8% 


0.92 [0.62, 1 .36] 


Li2009 


13 


15 


11 


15 


2.0% 


1.18 [0.82, 1.70] 


Liu2010 


12 


15 


7 


15 


0.8% 


1.71 [0.94, 3.12] 


Reynolds2008 


11 


15 


14 


15 


2.4% 


0.79 [0.56, 1.10] 


Schneider2006 


11 


15 


12 


15 


1 .8% 


0.92 [0.62, 1.36] 


Shi2010 


13 


15 


14 


15 


3.9% 


0.93 [0.73, 1.18] 


Sun2011 


12 


15 


13 


15 


2.5% 


0.92 [0.67, 1.27] 


Xiong2008a 


12 


15 


10 


15 


1 .5% 


1 .20 [0.77, 1 .86] 


Xue2009 


12 


15 


9 


15 


1 .2% 


1.33 [0.82, 2.16] 


Zeng2010 


12 


15 


9 


15 


1 .2% 


1.33 [0.82, 2.16] 


Han2006 


6 


15 


8 


15 


0.5% 


0.75 [0.34, 1 .64] 


Wu2007 


8 


15 


13 


15 


1.1% 


0.62 [0.37, 1.03] 


Yeh2009 


7 


15 


8 


15 


0.6% 


0.88 [0.43, 1.80] 


Chang2005 


10 


15 


10 


15 


1.1% 


1.00 [0.60, 1.66] 


Song2007 


10 


15 


12 


15 


1 .5% 


0.83 [0.54, 1.29] 


Chen2008 


2 


15 


8 


15 


0.2% 


0.25 [0.06, 0.99] 


da Silva2005 


9 


15 


10 


15 


1 .0% 


0.90 [0.52, 1.55] 


Gaudernack2006 


5 


15 


7 


15 


0.4% 


0.71 [0.29, 1.75] 


Harper2006 


10 


15 


11 


15 


1 .3% 


0.91 [0.57, 1.45] 


Liu2008 


1 


15 


9 


15 


0.1% 


0.11 [0.02, 0.77] 


Kvist2007 


3 


15 


11 


15 


0.3% 


0.27 [0.09, 0.78] 


Najafizadeh 2006 


4 


15 


4 


15 


0.2% 


1.00 [0.31, 3.28] 


Harper2006b 


4 


15 


11 


15 


0.4% 


0.36 [0.15, 0.89] 


Jiang2007 


7 


15 


7 


15 


0.5% 


1.00 [0.47, 2.15] 


Li2008 


11 


15 


11 


15 


1 .5% 


1.00 [0.65, 1.54] 


Smith2010 


12 


15 


13 


15 


2.5% 


0.92 [0.67, 1 .27] 


Witt2008 


6 


15 


7 


15 


0.5% 


0.86 [0.38, 1.95] 


Yi2009 


6 


15 


12 


15 


0.7% 


0.50 [0.26, 0.98] 


Zhang2006a 


5 


15 


9 


15 


0.5% 


0.56 [0.24, 1.27] 


Zhang2006b 


6 


15 


9 


15 


0.6% 


0.67 [0.32, 1 .40] 


Elden2005 


8 


15 


11 


15 


0.9% 


0.73 [0.41, 1.28] 


Muller2005 


7 


15 


7 


15 


0.5% 


1.00 [0.47, 2.15] 


Deng2007 


6 


15 


13 


15 


0.7% 


0.46 [0.24, 0.88] 


Vickers2005 


4 


15 


12 


15 


0.4% 


0.33 [0.14, 0.80] 


Borup2009 


8 


15 


9 


15 


0.8% 


0.89 [0.47, 1 .67] 


Hantonshzadeh2007 


11 


15 


13 


15 


2.0% 


0.85 [0.59, 1 .22] 


Huang2008 


6 


15 


7 


15 


0.5% 


0.86 [0.38, 1.95] 


Martensson2008 


11 


15 


11 


15 


1 .5% 


1.00 [0.65, 1.54] 


Qu2007 


7 


15 


9 


15 


0.7% 


0.78 [0.39, 1.54] 


Amir2007 


4 


15 


7 


15 


0.3% 


0.57 [0.21, 1.55] 


Ziaei2006 


8 


15 


8 


15 


0.7% 


1.00 [0.51, 1.95] 


Sharma2007 


7 


15 


9 


15 


0.7% 


0.78 [0.39, 1.54] 


Endres2007 


6 


15 


13 


15 


0.7% 


0.46 [0.24, 0.88] 


Jena2008b 


5 


15 


7 


15 


0.4% 


0.71 [0.29, 1.75] 


Melchart2005 


7 


15 


12 


15 


0.8% 


0.58 [0.32, 1.06] 


Soderberg2006 


7 


15 


12 


15 


0.8% 


0.58 [0.32, 1.06] 


Liu2006 


3 


15 


7 


15 


0.2% 


0.43 [0.14, 1.35] 


Total (95% CI) 




1380 




1380 


100.0% 


0.84 [0.79, 0.88] 



Risk Ratio 
M-H, Random, 95% CI 



Total events 752 951 

Heterogeneity: Tau 2 = 0.01 ; Chi 2 = 99.31 , df = 91 (P = 0.26); I 2 ' 
Test for overall effect: Z = 6.20 (P < 0.00001) 



0.2 0.5 1 2 5 

Items less reported in SR Items more reported in SR 



therapeutic effects which combination of potential 
therapeutic components works best, or whether combin- 
ation of several components during the acupuncture 



treatment is additive or synergistic. Therefore, it would 
be a reasonable suggestion for reviewers to report com- 
ponent factors of acupuncture that seems potentially 
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Table 3 The number of component studies in Cochrane reviews and of original RCTs with reporting of selected STRICTA 


items 














Component 










studies in 












Cochrane reviews 


Original RCTs 




Items 


n/M 

n/iM 


\/o) 


n/M 

n/iM 




Difference (95% CI)* 


A. Acupuncture rationale 












(i ; oiyie ot acupuncture ireaimem 


59/92 


(64.1) 


66/92 


(71.7) 


/ .D \ \ .1 TO 14.1 ) 


rteasoning ot ireaimeni 


6/92 


(6.5) 


42/92 


(45.6) 


oy.i ^10. 1 TO OU.^lj 


(oj txieni to wnicn TreaTmenT was vaneu 


76/92 


(82.6) 


87/92 


(94.6) 


l^.U (4.^: TO ly.JDj 


Total section A 












B. Needling details 












/i \ Kill yy\ y AT K*\ /~\ /~\ /"N | /~\ O 

^ i j iNurnuer ot neeaies 


76/92 


(82.6) 


84/92 


(91.3) 


0. / (i .y to 1 0.0) 


(2) Names of points 


74/92 


(80.4) 


84/92 


(91.3) 


lU.y \tL.( TO iy.u; 


\o) uepTns ot insertion 


36/92 


(39.1) 


41/92 


(44.6) 


0.4 /.i to i /.y; 


rtesponse to neeuie 


53/92 


(57.6) 


63/92 


(68.5) 


1 u.y (u.u to d. \ .1 ) 


/ C \ N| 1 /-v o+Iky~ii Motion 

^oj iNeeuie siiriiuicuiori 


42/92 


(45.7) 


64/92 


(69.6) 


9Q Q HQfitn QA 0\ 
y ^ lo.D TO O^.c.) 


(6) Retention time 


69/92 


(75.0) 


81/92 


(88.0) 


■i O C\ 1 A A \r\ OH c\ 

1 o.U (4.4 TO *:1 .D) 


(7) Needle type 


18/92 


(19.6) 


60/92 


(65.2) 


4b./ (o4.4 TO bb.yj 


Total section B 












o. i rediriieru reginieri 












(1) Number of sessions 






Q0/Q9 
yu/y^ 


/Q7 o\ 


b.4 (— U.o TO 1 1 .^1) 


rrequeriuy/uurdiiori 


85/92 


(92.4) 


88/92 


(95.7) 


0.0 (—^i.O 10 y. 1 ) 


1 Uld.1 oUUUUll 












U. 1 lcd.ll llci 11 UUI UcaI 












(1) Details of other treatments 


15/92 


(16.3) 


31/92 


(33.7) 


17.4 (8.6 to 26.2) 


(2) Setting and context 


2/92 


(2.2) 


19/92 


(20.7) 


18.5 (9.5 to 27.5) 


Total section D 












E. Practitioner background 












(1) Description of acupuncturists 


56/92 


(60.9) 


51/92 


(55.4) 


-5.4 (-15.2 to -4.4) 


*Higher number means favourable results to RCTs. 












RCTs, randomised controlled trials. 













contributable to the effectiveness which are well- 
represented in STRICTA, until future researches eluci- 
date the therapeutic role of each component or group 
of components in the acupuncture treatment. 

One possible explanation of inconsistent and subopti- 
mal reporting of acupuncture treatment-related informa- 
tion would be that the Cochrane reviewers might not 
perceive some items of STRICTA as relevant to their 
review and selectively depicted some items of STRICTA. 
In a small survey of Prady and Macpherson, 14 some trial- 
ists and Cochrane review authors did not perceive some 
items of the previous version of STRICTA as relevant to 
acupuncture treatments. Another reason might be a lack 
of standard reporting guideline for interventions in the 
Cochrane review Either Cochrane review authors or 
CRG correspondence reported that they did not know 
the existence of reporting guidelines for acupuncture. 
To date, however, there is no study investigating reasons 
for the selective reporting intervention-related informa- 
tion (including acupuncture) in Cochrane reviews. 
Since information related to the treatment intervention 
is essential to enhance the external validity, applicability 
and implementation of results of systematic review, 5 bar- 
riers to the optimal quality of reporting for treatment 



intervention should be explored and tackled in future 
studies. 

Removal of STRICTA-specific information in the 
reporting due to the journal's space constraints or sug- 
gestions of editors as well as peer-reviewers was 
addressed by some trial authors. 14 This may be the case 
for the systematic review published in non-Cochrane 
medical journals which have limited word counts. 14 In 
our research, the possibility of potential influence of 
space constraints on suboptimal reporting seems 
unlikely because Cochrane review allows review authors 
to describe the main characteristics of each included 
study without any space constraints. However, lack of 
comparison of the reporting quality of acupuncture 
intervention in Cochrane reviews with those in 
non-Cochrane reviews published in journals with space 
constraints do not provide evidence to support this argu- 
ment. Future research incorporating Cochrane and 
non-Cochrane reviews may reveal whether there is any 
systematic differences of reporting quality in terms of 
the details of treatment intervention between Cochrane 
and non-Cochrane reviews, thus space constraints could 
be an influencing factor to the reporting quality of 
intervention-related information or not. 
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Evaluation of internal validity has been put on great 
emphasis in the Cochrane systematic reviews. 9 15 
However, evaluating applicability of review results may 
also be of similar importance, since uptake and repro- 
duction of review results may be able to change the 
routine clinical practice towards evidence-based prac- 
tice. 5 Lack of consideration of external validity is a 
major criticism of systematic reviews and RCTs, and is a 
potential threat of poor uptake of evidence into routine 
clinical practice. 16-19 Intervention details and treatment 
contexts which STRICTA aims to address are suggested 
as the determinants of external validity in trial, system- 
atic review and guideline publications, 20-22 although 
little is known whether detailed description of acupunc- 
ture interventions in systematic reviews can affect uptake 
of evidence in practice. Whether selective reporting of 
acupuncture interventions observed in our study would 
influence the uptake of evidence may deserve further 
research. 

Strengths and weakness 

STRICTA is the best representative recommendation 
agreed by international acupuncture experts, constitut- 
ing core components of acupuncture treatment that 
may be inter-related. 3 However, STRICTA had not been 
developed to measure the quality of reporting acupunc- 
ture interventions, although we summed the scores of 
each items to score the overall quality of reporting acu- 
puncture interventions. Since this method is not based 
on the original purpose of STRICTA and there is no 
weighting criteria for each item, interpretations of our 
results should be cautious. 8 The scores should not be 
understood as the exact quantitative estimates across the 
studies, but as possible indicators of incompleteness of 
reporting details of acupuncture. 

Results of rating might be prone to subjective assess- 
ment, although extensive training of authors using 
CONSORT elaboration document 3 was preceded. Two 
assessors were unblinded to the study characteristics, 
such as publication dates or allocation of acupuncture as 
a primary or control intervention. Since both assessors 
are acupuncture researchers as well as practitioners, they 
may be familiar with included acupuncture studies; we 
did not attempt to blind the assessors. Prady et af* found 
that unblinded assessor gave higher scores to some of 
the acupuncture studies in terms of items of STRICTA, 
although this tendency was not consistent with the rest 
of the studies to be assessed. Nevertheless, unblinded 
assessors with prior knowledge of study characteristics in 
our review may have introduced bias. 

The first STRCITA was published in 2001, and as a 
revised version in 2010. We adopted the revised version 
of STRICTA for studies which had been published 
before and after it. Thus, component studies published 
before the publication of revised STRICTA may not 
address some revised items assessed in this review. This 
may have yielded a systematic bias when assessing the 
component studies by disadvantaging articles following a 



previous version of the guideline. Nevertheless, the util- 
isation of the latest version of STRICTA was justified in 
our study with three reasons: first, the CONSORT initia- 
tives recommended the use of most recently released 
version of reporting standards when reporting and ana- 
lysing RCTs. 20 Second, the ultimate aim of using 
STRICTA in this study was not to score component 
studies per each item, but to reflect whether and how 
Cochrane reviews report or omit essential component of 
acupuncture treatments which were deemed the best 
representation of consensus across international acu- 
puncture experts. Third, we identified that selected 
components for this review in the original STRICTA and 
in the revised one is almost consistent enough to justify 
the use of the latest version of STRICTA. In this sense, 
the latest version of STRICTA was preferred. 

Uptake of reporting guidelines by individual research- 
ers and journal editors may take a longer period than 
expected. A survey of author instructions conducted in 
2007 revealed that only 38% of 165 high-impact journals 
endorsed the CONSORT statement, which was initially 
published in 1996. 21 The median values of the publica- 
tion years of the primary component studies and 
Cochrane reviews used in this study were 2007 and 2010, 
respectively. The first STRICTA statement was published 
in 2001, and insufficient time may have elapsed to justify 
our research. This should be recognised as a weakness 
of our study, and future follow-up studies may overcome 
this issue. 

We did not contact authors of the primary component 
studies to gain additional information with regard to the 
under-reported items of STRICTA. This was because our 
primary interest is to identify selective reporting/omis- 
sions of acupuncture-related information during the 
review process in the Cochrane reviews. Given the 
authors of primary component studies are often con- 
tacted to gain additional information when conducting 
systematic review, however, our study might not reflect 
common information-seeking procedure during review 
process. Author's contact would have brought to what 
extent Cochrane reviews could have comprehensively 
described the treatment-related information of acupunc- 
ture based on the standard author query process recom- 
mended in the Cochrane Handbook. 22 Future follow-up 
study may address such limitation. 

Implication for future research 

Factors associated with how and why review authors 
selectively summarise the treatment intervention during 
the review process should be investigated to identify the 
potential barrier of optimal quality of reporting in 
Cochrane reviews of acupuncture. Recent empirical evi- 
dence supports that the utilisation of reporting guide- 
line (ie, CONSORT, STROBE, TREND and STARD) 
with regard to general methodological issues during 
peer review processes improves the quality of publication 
in biomedical journals. 23 Whether and how reporting 
guidelines for the description of treatment intervention 
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such as STRICTA can be efficiently utilised during edi- 
torial and peer-review process and provided as author- 
support resources in CRG websites should be explored 
to improve the reporting quality of treatment interven- 
tion. Whether and how reporting items of STRICTA 
explaining theoretical background, mechanical aspects 
and contextual factors of acupuncture could contribute 
to the investigation of clinical heterogeneity of acupunc- 
ture treatments and their potential impacts on the direc- 
tion and significance of effect estimates should also be 
explored. Whether loss of treatment-related information 
actually leads to an altered replicability of reported inter- 
ventions in Cochrane reviews was not investigated in this 
study, and should also be investigated in future research. 



CONCLUSIONS 

The reporting quality of treatment details in Cochrane 
reviews of acupuncture was insufficient with regard to 
STRICTA recommendation, even though information was 
readily reported in primary component studies. STRICTA 
was rarely utilised by CRGs and review authors. Use of 
STRICTA guideline for the reporting treatment details in 
Cochrane reviews and peer-review process should be con- 
sidered to improve the replicability and utilisation of 
review results in future research and clinical practice. 
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